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Adaptive Thresholding to improve Average Color 
Extraction for Controlling Ambient Lighting Systems 

Low intensity LED colors do not provide a realistic match with the colors shown on the 
television. For example, if the content contains 95% of black pixels and 5% of red ones, 
the perceived color of the television output to the human eye will be black. If however 
the LEDs are set to 5% red emittance, the perceived color of the wall reflection to the eye 
will be a dark red. Because there is no way to use LEDs for showing dark colors, a better 
approach would be to switch the LEDs off whenever the intensity of the extracted 
average color for a particular region falls below a certain threshold and switch them on 
again when it is above the threshold. This problem could be visualized below in Figure 1. 




> 

Time 

Figure 1: Output of LEDs across time 



Although this way of using the threshold was an improvement, there still was a problem 
in cases where the extracted average color intensity fluctuates around the threshold value. 
In such a case the LEDs were switched off and on repeatedly, sometimes several times in 
a second, which led to a very annoying flickering experience. Thus we define a two-band 
approach where in, when the LEDs fall below an initial threshold they are switched off 
and they are switched on again when they are above both the initial and the secondary 
threshold (see Figure 2.). 
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The general steps that need to be followed to realize the invention are as follows: 

1) Acquire a video signal and decode the video signal into a set of frames 

2) Extract color information from the content (frames) around the boundary 

3) Transform the color information of the content from the RGB space onto the color 
space of the LEDs and the displays color space. 

4) Perform gamma correction negation 

5) Threshold the color output 

6) Transmit the threshoided color output to the LED units so as to trigger them. 
Steps (1) and (6) are straightforward and are not further discussed below. 
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The current setup for an ambient lighting system is as shown below: 



Sub-light 




Light speakers 



Centre Light 



Light speakers 



Figure 3. Setup of Light Units 



In the above figure there are 11 independently controllable LED lighting units. There are 
four light speakers, one unit under the couch ('Sub-light') and 6 LED units on the center- 
light. The center-light is a little bit special, in the way it is set-up - it has 6 independently 
controlled, light units behind the four sides of the Flat TV and is shown below: 




In the above figure LI to L6 refer to the light units around TV. The figure also shows a 
single frame of the content displayed on the TV. Each light unit located at the back of the 
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TV is triggered by extracting the average color information from each region - Rl to R6. 
Each region has a width of 100 pixels. As an example if the size of the frame were 
720x576 pixels, then the size of Rl, R2, R4 and R5 would be 360x100 pixels. Similarly 
size of R3 and R6 would be 1 00x376 pixels. 

Since the video signal is decoded into a set of frames (25 frames per second) in the RGB 
color space, the resulting image size would be 720x576x3 which is a 3D matrix where 
each 2D matrix of size 720x576 corresponds to each one of the Red, Green and Blue 
channels. 



The average color information for each region of the channel is extracted by summing up 
all the pixels in that region and dividing by the total number of pixels in that region for 
each channel The equation for the extraction of the average color information for each 
region for one channel is shown below: 



iW nxm 

If the region under consideration is Rl, then fyf 9 is of size 360x100 with n equal to 360 

and m equal to 100. The above equation gives us the average of all the pixels for the red 
channel. Thus the average color for particular region would now be a triplet, 

RaVE = \Rred 9 Rgreen 9 Rbtue\ 

The same procedure is repeated for all the regions and for all the channels within each 
region. 

Next in order to set the lights, a mapping transformation needs to be performed between 
the TV and light units. This is achieved via a standard set of equations that take as input 
the measured color primaries from each LED unit. The color primaries for the red, green, 
blue and the reference white color components are acquired by using a color 
spectrometer. Once the primaries are obtained, the transformation process is as follows: 

(a) Given a set of chromaticity (red, green and blue primaries) co-ordinates and 
the reference white, compute the transformation matrix for mapping the 
average color information onto the XYZ color gamut space for both the FLAT 
TV as well as the LED units. This gives us two set of equations : 

[X; Y; Z]=M, * [R;G;B] for Flat TV 

[X; Y; Z]-M 2 * [R';G'B'] for LED's 

(b) The mapped RGB values for the light units could be found by solving the 
following: 

[R'jG'jB^M^M^IRjGjB] 

In steps (a) above, [R; G; B] corresponds to the triplet which is nothing but the computed 
average color information for a particular region for all channels. The general method for 
computing the matrix M is shown below: 
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Given the chromaticity coordinates of an RGB system (x r ,y r ), (x g ,yg) and (x b ,y b ) and the 
white point (x w ,y w ), the method to compute the 3 x 3 matrix for converting RGB to XYZ 
is as follows: 

[XYZ] = [RGB][M\ 



where 
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The above method is used for obtaining Mi and M 2 and [R' G' B'] by following step (b) 
above. Thus [R';G';B'] is the transformed color information for a particular region. The 
same process is repeated for obtaining [R' G' B'] for each of the 6 regions. 

The transformed color information is then accounted for gamma correction negation and 
• this is done as follows: gamma corrected [R* G* B*] = [R AX> G* x ' B AX '], where the 
optimum gamma X values has been found to be 1 .8 

Two different embodiments are considered for thresholding the color information. Li the 
first case, only if all the three RGB values are below some threshold T, the corresponding 
LED strip will be switched off. An optimum threshold was found to be 0.05. In the case 
of a two-band approach, if all the RGB values are less than some threshold T, the LEDs 
are switched off. But, to avoid flickering, the threshold value for this particular LED strip 
to be switched on again, is raised to T+B. So if one of the RGB values becomes > T+B 
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the LEDs will be switched on again and then the threshold value will be set back to T. 
Again the optimum threshold value for the two ban approach has been found to be 0.05 
for T and 0,03 for B. Thus if all values < 0.05, switch off. If a value > 0.08, switch back 
on. 

The thresholded color information is then sent to the light units so that they can be 
triggered. Please note that the whole process is repeated for all the frames (25) in each 
second. It is also important to note that the width of each region could be varied and the 
number of regions in the frame could also be varied. As an example, instead of using 6 
regions, one could use only 4 regions as well. In such a case, the thresholded color 
information for the upper region could be sent to both the LED panels located at the top 
of the TV. Furthermore, the solution discussed above could be realized in software or via 
a programmable hardware platform such as EPLD, etc. 
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